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Integrated circuit and method for packet switching control 



08.03.2004 



The invention relates to an integrated circuit having a plurality of processing 
modules and an interconnect means for coupling said plurality of processing and a method 
for packet switching control in such an integrated circuit. 

Systems on silicon show a continuous increase in complexity due to the ever- 
increasing need for implementing new features and improvements of existing functions. This 
is enabled by the increasing density with which components can be integrated on an 
integrated circuit. At the same time the clock speed at which circuits are operated tends to 
increase too. The higher clock speed in combination with the increased density of 
components has reduced the area which can operate synchronously within the same clock 
domain. This has created the need for a modular approach. According to such an approach 
the processing system comprises a plurality of relatively independent, complex modules. In 
conventional processing systems the systems modules usually communicate to each other via 
a bus. As the number of modules increases however, this way of communication is no longer 
practical for the following reasons. On the one hand the large number of modules forms a too 
high bus load. On the other hand the bus forms a communication bottleneck as it enables only 
one device to send data to the bus. 

A communication network forms an effective way to overcome these 
disadvantages. Networks on chip (NoC) have received considerable attention recently as a 
solution to the interconnect problem in highly complex chips. The reason is twofold. First, 
NoCs help resolve the electrical problems in new deep-submicron technologies, as they 
structure and manage global wires. At the same time they share wires, lowering their number 
and increasing their utilizationTlSfoCs can also be energy efficient and reliable and are r ™ 
scalable compared to buses. Second, NoCs also decouple computation from communication, 
which is essential in managing the design of billion-transistor chips. NoCs achieve this 
decoupling because they are traditionally designed using protocol stacks, which provide well- 
defined interfaces separating communication service usage from service implementation. 
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Using networks for on-chip communication when designing systems on chip 
(SoC), however, raises a number of new issues that must be taken into account. This is 
because, in contrast to existing on-chip interconnects (e.g., buses, switches, or point-to-point 
wires), where the communicating modules are directly connected, in a NoC the modules 
communicate remotely via network nodes. As a result, interconnect arbitration changes from 
centralized to distributed, and issues like out-of order transactions, higher latencies, and end- 
to-end flow control must be handled either by the intellectual property block (IP) or by the 
network. 

Most of these topics have been already the subject of research in the field of 
local and wide area networks (computer networks) and as an interconnect for parallel 
machine interconnect networks. Both are very much related to on-chip networks, and many 
of the results in those fields are also applicable on chip. However, NoCs premises are 
different from off-chip networks, and, therefore, most of the network design choices must be 
reevaluated. On-chip networks have different properties (e.g., tighter link synchronization) 
and constraints (e.g., higher memory cost) leading to different design choices, which 
ultimately affect the network services. 

NoCs differ from off-chip networks mainly in their constraints and 
synchronization. For on-chip networks computation too comes at a relatively high cost 
compared to off-chip networks. An off-chip network interface usually contains a dedicated 
processor to implement the protocol stack up to network layer or even higher, to relieve the 
host processor from the communication processing. Including a dedicated processor in a 
network interface is not feasible on chip, as the size of the network interface will become 
comparable to or larger than the IP to be connected to the network. Moreover, r unnin g the 
protocol stack on the IP itself may also be not feasible, because often these IPs have one 
dedicated function only, and do not have the capabilities to run a network protocol stack. 

The number of wires and pins to connect network components is an order of 
magnitude larger on chip than off chip. If they are not used massively for other purposes than 
NoC communication, they allow wide point-to-point interconnects (e.g., 300-bit links). This 
isnot possMe off-cM^ 

Introducing networks as on-chip interconnects radically changes the 
communication when compared to direct interconnects, such as buses or switches. This is 
because of the multi-hop nature of a network, where communication modules are not directly 
connected, but separated by one or more network nodes. This is in contrast with the prevalent 
existing interconnects (i.e., buses) where modules are directly connected. The implications of 
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this change reside in the arbitration (which must change from centralized to distributed), and 
in the communication properties (e.g., ordering, or flow control). 

With the increasing success of portable devices like mobile phones, PDA, 
notebooks, MP3-players or the like, the power consumption is becoming a very important 
issue within modem integrated circuits and the design thereof. As the VLSI design of such 
ICs is shifting into the nanometer domain, the energy which is dissipated by the interconnect 
in a system-on-chip becomes a significant part of the overall system power consumption. 

The actual energy consumption of the interconnect, i.e. the network, is not 
only based on the physical properties of the interconnect, like the voltage swing, the wire 
delay, the topography of the interconnect or the like, but also on the data flow in the system- 
on-chip, i.e. the processor-processor communication and the processor-memory 
communication. This communication is usually transaction based and can be of the 
following origins: cache and memory transactions (data fetch from shared memory), cache 
coherence operations (updated data in a shared memory must be updated in all cache copies 
15 resisting in synchronization traffic), packet segmentation overheads (segmenting dataflow 
into packets will introduce an additional data overhead) or contentions between packets (re- 
routing packets in case of a contention). 

Typically, the above packets in the system on chip comprise a header 
containing the destination address, the source address and the requested operation like, 
20 READ, WRITE, INVALIDATE etc. The payload of a packet comprises the data to be 

transported. Optionally, a tail comprises a error checking and a correction code. There may 
several different data packets present in the above system-on-chip, namely for memory 
access requests, for cache coherence synchronization, for data fetch, for data update and for 
IO and interrupts. Memory access request packets serve to request data from a shared 
25 memory and comprise a header with the destination address of a target memory and the 

requested memory operation. As no data is transported, the payload will be empty. The cache, 
coherence synchronization packet is sent from an updated memory to all caches with a copy 
thereof. This packet may comprise data as payload if the data in the caches are to be updated 

orxnay comprise d data if the data in the cacbesnare ^be invalidatedrwherein the header ~ 

30 may comprise the particular operation type. The data fetch packet serves as a reply packet 
from a memory and contains the requested data as payload while the header contains the 
target address. The data update packet serve to write data back into a memory and contains 
the target address in the header and the respective data as the payload. The IO and the 
interrupt packet contains a header with the destination address and if a data exchange is 
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involved the payload may contain the data. Accordingly, the content of the header as well as 
of the payload will depend on the transaction. 

The above-mentioned operations like cache misses, data fetch, memory 
updates and cache synchronization involve a sending of data over the interconnect. However, 
sending packets over the interconnect result in an energy dissipation on the interconnect 
wires and in the logic gates inside each switch. When a data packet travels through the 
interconnect the interconnect wires and the logic gates along the data path will toggle if the 
data stream reverses its polarity. Accordingly, energy is consumed for each bit in the 
interconnect lines and in the logic gates. 

Li a multi-hop interconnect the packet data path may vary depending on the 
actual data traffic conditions. Packets with identical sources and destinations do not 
necessarily travel the same data path, i.e. the number of hops as well as the same actual path. 
However, the numbers of hops traveled by a packet will effect the energy dissipation of the 
data transport as every hop includes interconnect wires and a number of logic gates. For more 
information regarding the energy dissipation in systems on chip please refer to " 66 PacketizedP 
On-Chip Interconnect Communication Analysis for MPSoC" by Ye et al. in Design 
Automation and Test in Europe, DATE 2003, Proceedings, page 344-349. 



It is therefore an object in the invention to reduce the power consumption in a 
system-on-chip environment. 

This object is achieved by an integrated circuit according to claim 1 and a 
method for packet switching control according to claim 5. 

Therefore, an integrated circuit having a plurality of processing modules and 
an interconnect means for coupling said plurality of processing modules and for enabling a 
packet based communication based on transactions between said plurality of processing 
modules is provided. Each packet comprises a first predetermined number of subsequent 
words each having a second predetermined number of bits. A first of said plurality of 
process^ at least one f packet ^overwd interconnect 

means to a second of said plurality of processing modules. The integrated circuit further 
comprises at least one packet inspecting unit for inspecting bits of said at least one packet to 
determine bits not required for said issued transaction and for matching said not required bits 
of said at least one inspected packet with other bits of the same packet. 
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As the matching is preformed hy other hits of one and the same packet, the 
energy loss associated to the switching of logical gates in a switch can be reduced along the 
entire data path through the interconnect, since the matching only depends on bits of the same 
packet, which do not change along the data path via the interconnect. 

According to an aspect of the invention said at least one packet inspecting unit 
matches said not required bits witb previous or following bits in the same packet. Thereby, 
the energy loss associated to the switching of logical gates in a switch when subsequent bits 
change their polarity can be reduced. 

According to a preferred aspect of the invention said at least one packet 
inspecting unit matches said not required bits with corresponding bits in a previous or 
following word in the same packet. As the packets are arranged in subsequent words, this 

solution is easy to implement 

According to a further preferred aspect of the invention said integrated circuit 
comprises at least one network interface associated to said first of said plurabtyof processing 
modules "for controlling the communication between said first of said plurality of processing 
modules and said interconnect means. Each of said at least one packet inspecting units is 
arranged in one of said network interfaces. As the header of the packet as well as its payload 
is present in the network interface associated to the first processing module and the bits of the 
packet will not change along their data path through the interconnect, the network interface is 
the preferred place to perform the matching of the unused bits. 

The invention also relates to a method for packet switching control in an 
integrated circuit having a plurality of processing modules and an interconnect means for 
coupling said plurality of processing modules and for enabling a packet based 
communication based on transactions between said plurality of processing modules. Each 
packet comprises a first predetermined number of subsequent words each having a second 
predetermined number of bits. A first of said plurality of processing modules issues a 
transaction by sending at least one packet over said interconnect means to a second of said 
plurality of processing modules. Bits of said at least one packet are inspected to determine 
— bitsnot required for the issued transaction and said not required bits of said at least one * 
inspected packet are matched with other bits of the same packet. 

Further aspects of the invention are described in the dependent claims. 
These and other aspects of the invention are apparent from and will be 
elucidated with reference to the embodiments) described hereinafter. 
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Fig. 1 shows a basic block diagram of a network on chip according to the 

invention 

Figs. 2A and 2B shows the basic structure of packets used in the invention, 

and 

Figs. 3A and 3B show a basic block diagram of a packet inspecting unit 
according the prior art and according to the invention. 



The following embodiments relate to systems on chip, i.e. a plurality of 
modules on the same chip communicate with each other via some kind of interconnect. The 
interconnect is embodied as a network on chip NOC. The network on chip may include 
wires, bus, time-division multiplexing, switch, and/or routers within a network. At the 
transport layer of said network, the communication between the modules are performed over 
connections. A connection is considered as a set of channels, each having a set of connection 
properties, between a first module and at least one second module. For a connection between 
a first module and a single second module, the connection comprises two channel, namely 
one from the first module to the second channel, i.e. the request channel, and a second from 
the second to the first module, i.e. the response channel. The request channel is reserved for 
data and messages from the first to Ihe second, while the response channel is reserved for 
data and messages from the second to the first module. However, if the connection involves 
one first and N second modules, 2*N channels are provided. The connection properties may 
include ordering (data transport in order), flow control (a remote buffer is reserved for a 
connection, and a data producer will be allowed to send data only when it is guaranteed that 
space is available for the produced data), throughput (a lower bound on throughput is 
guaranteed), latency (upper bound for latency is guaranteed), the lossiness (dropping of data), 
transmission terniination, transaction completion, data correctness, priority, or data delivery. ' 

The modules as described the following can be so-called intellectual property 
blocks IPs (computation elements; memories or a subsystenrwhich may internally contain— 
interconnect modules) that interact with network at said network interfaces NI. A network 
interface NI can be connected to one or more IP blocks. Similarly, an IP can be connected to 
more than one network interfaces. 

Fig. 1 shows a basic block diagram of a network on chip according to a first 
embodiment. In particular, a master module M and a slave module S each with an associated 
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network interface NI are depicted. Each module M, S is connected to a network N via its 
associated network interface NI, respectively. The network interfaces NT are used as 
interfaces between the master and slave modules M, S and the network N. The network 
interfaces NI are provided to manage the communication between the respective modules M, 
S and the network N, so that the modules can perform their dedicated operation without 
having to deal with the communication with the network or other modules. The network 
comprises a plurality of interconnected routers R. The routers R serve to forward commands 
and data to the next router R or to a network interface. For more details on the router 
architecture please refer to Rijpkema et al, "A Router Architecture for Networks on Silicon", 
Proceedings of Process 2001, 2nd Workshop on Embedded Systems, or "Trade Offs in the 
Design of a Router with Both Guaranteed and Best-Effort Services For Networks on Chip", 
by Rijpkema et al in Design, Automation and Test in Europe Conference and Exhibition 
(DATE ? 03) March 03 - 07, 2003 Munich, Germany. 

As the bandwidth of the network in the network-on-chips is usually fixed for 
all types of transactions and communications between the master and slave modules M, S, in 
certain cases some of the bits in a packet may not be required for the communication or a 
transaction. One example can be a memory access request as described above, since the 
payload of such a packet is empty. An alternative example of unused bits can be if a target or 
slave has an address range which needs less address bits as allocated in the header of the 
packet. The same may be applicable for the data in the payload. 

Therefore, a packet inspecting unit PIU is arranged in the network interface NI 
associated to the master module M. The packet inspecting unit PIU serves to control the 
packet switching for packets sent from the master module M. 

Fig. 2 shows the basic structure of packets used in the invention. In particular, 
Fig. 2A shows two packets followed by each other on a link and a packet switching based on 
a standard technique of matching of bits in two subsequent packets. Fig. 2B shows a 
preferred example of the packet and a packet switching based on a matching of bits within 
the same packet. In both Figs, unused bits are marked with U\ 'p' corresponds to header bits 
related to the path, and 'fc^con-esponds to the flow control, while may be piggy backed in 
the header. It should be noted that T ? for path and ? fc f for flow control are merely examples. 
Alternatively, a destination address may be included. 

The packets are each 8-bit wide and 3 words deep. However, other bit widths 

and word depths are also possible. 
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In Fig. 2A, the unused bits U in the packet i are matched against the previous 
corresponding bits in a word of a previous packet i - 1. This is performed by making the 
unused bits U equal the previous bits, i.e. payload bits of the previous packet, as indicated by 
the dashed arrows in Fig. 2 A. However, as the sequence of the packets may change at every 
router R along the path across the network, this matching must be performed for every router 
R along the path. Accordingly, a unit for controlling the packet switching may be 
implemented in every router, which will result in a cost intensive implementation. 

An improved matching of unused bits according to a preferred embodiment is 
shown in Fig. 2B. Here, the matching is preferably performed in a network interface NT of a 
master module M from which the packet originates. Additionally or alternatively, the 
matching may be performed in the network interfece NI of a slave module M As the header 
information of the packet as well as the payload is present in the network interface NI, the 
matching can be done therein. Since the packet and in particular the payload will not change 
during its path through the network N, the bits of the packet can be optimized to minimizing 
the power consumption by reducing the switching between ^ bitsofsubsequent or previous 
words in a packet. Preferably, the matching is performed between bits of subsequent words, 
i.e. bits are matched to following bits. As the bits will not change during their path through 
the network, the intra packet switching sequence will be the same for all router R. In 
particular, the unused bits in the header of packet i, are matched against the pi bits in the 
same packet 

Figs. 3 show a basic block diagram of a packet inspecting unit according the 
standard technique and according to the invention. In Fig. 3 A a packet inspecting unit is 
shown which is based on keeping unused bits equal to zero, while Fig. 3B shows a packet 
inspecting unit PIU according to a preferred embodiment. 

The packet inspecting unit PIU of Fig. 3A comprises three multiplexer Ml 

M3, a first and second header creation unit HCU1, HCU2 and three FIFOs F1-F3. The 
outputs of the first and second header creation unit HCU1, HCU2 are coupled to first inputs 
of the first and second multiplexer Ml, M2, respectively. The second inputs of the first, 
second and thirdTnultiplexer Ml-M3~arenco^ 

respectively. The first input of the third multiplexer M3 is set to H)\ Alternatively, the first 
input is set to T. 

The packet inspecting unit PIU of Fig. 3B comprises merely two multiplexer 
Ml— M2, a first and second header creation unit HCU1, HCU2 and three FIFOs F1-F3. The 
outputs of the first and second header creation unit HCU1, HCU2 are coupled to first inputs 
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of the first and second multiplexer Ml, M2, respectively. The second inputs of the first, and 
second multiplexer M1-M2 are coupled to the first and second FIFOs F1-F2, respectively. 
The output of the third FIFO F3 together with the outputs of the first and second multiplexer 
Ml, M2 are used as output of the packet inspecting unit PIU. 
5 Therefore, in addition to the power reduction via reduce switching, the packet 

inspecting unit PIU according to the invention also has a lower implementation cost than an 
implementation, which keeps these unused bits fixed, as the multiplexing of the payload or 
unused (thus fixed) bits can be omitted. By saving one multiplexer and accordingly saving a 
specific amount of logical gates, the power consumption is further reduced, as less logical 
10 gates are required for switching and therefore less power is dissipated by switching. This is in 
vast contradiction to the implementation cost of the standard technique, for which additional 
multiplexers and flip-flops are necessary. 

In an alternative embodiment, the matching techniques as described according 
to Fig. 2A and Fig. 2B may also be combined by performing the intra packet matching in a 
15 network interface before the packet travels through the network and by performing an inter 
packet matching in some of the routers R along its path through the network. 

In a further alternative embodiment the above described intra and/or inter 
packet bit matching may also be performed in the routers R of the network N. 

The reduced switching activity has a positive influence on the power 
20 consumption of several architectural components included in such a network like switches and 
FIFO as the switching of logic gates in these components. 

The above described switching technique is advantageous as compared to 
known power-reduction techniques that try to reduce the switching activity by 
encoding/decoding the information on a bus. This is because such encoding/decoding 
25 techniques do not save any power for realistic bus lengths, as the power needed for 

encoder/decoder, i.e. the power needed for switching logic gates in said encode/decoder, is to 

high. 

An alternative approach to handle unused bits is to keep them equal to 0 or 1 . 

However; tMs may introduce additional p^ like (1 -0 - l)~andis therefore not 

30 desired. 

While in the above embodiments the interconnect has been described as a 
network comprising routers, other multi-hop interconnects may also be possible. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many alternative 
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embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. The 
word "comprising" does not exclude the presence of elements or steps other than those listed 
in a claim. The word "a" or "an" preceding an element does not exclude the presence of a 
5 plurality of such elements. In the device claim enumerating several means, several of these 
means can be embodied by one and the same item of hardware. The mere feet that certain 
measures are recited in mutually different dependent claims does not indicate that a 
combination of these measures cannot be used to advantage. 

Furthermore, any reference signs in the claims shall not be construed as 
1 0 limiting the scope of the claims. 
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CLAIMS: 



1 . Integrated circuit having a plurality of processing modules (M, S) and an 
interconnect means (N) for coupling said plurality of processing modules (M, S) and for 
enabling a packet based communication based on transactions between said plurality of 
processing modules (M, S), wherein each packet comprises a first predetermined number of 

5 subsequent words each having a second predetermined number of bits, wherein a first of said 
plurality of processing modules (M) issues a transaction by sending at least one packet over 
said interconnect means to a second of said plurality of processing modules (S), comprising: 

at least one packet inspecting unit (PIU) for inspecting bits of said at least one 
packet to determine bits not required for said issued transaction and for matching said not 

10 required bits of said at least-one inspected packet with other bits of the-same-packet. 

2. Integrated circuit according to claim 1, wherein said at least one packet 
inspecting unit (PIU) is adapted to match said not required bits with previous or following 
bits in the same packet. 

15 

3. Integrated circuit according to claim 2 ? wherein said at least one packet 
inspecting unit (PIU) is farther adapted to match said not required bits with corresponding 
bits in a previous or following word in the same packet. 

20 4. Integrated circuit according to claim 2 or 3, further comprising: 

at least one network interface (NT) associated to said first of said plurality of 
processing modules (I) for controlling the communication between said first of said plurality 
of processing modules (I) and said interconnect means (N), wherein each of said at least one 
packet inspecting units (PIU) is arranged in one of said networ k interfaces (NI) : 

25 

5. Method for packet switching control in an integrated circuit having a plurality 

of processing modules (M, S) and an interconnect means (N) for coupling said plurality of 
processing modules (M, S) and for enabling a packet based communication based on 
transactions between said plurality of processing modules (M, S), wherein each packet 
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comprises a first predetermined number of subsequent words each having a second 
predetermined number of bits, wherein a first of said plurality of processing modules (M) 
issues a transaction by sending at least one packet over said interconnect means to a second 
of said plurality of processing modules (S), comprising the steps of: 

inspecting bits of said at least one packet to determine bits not required for the 
issued transaction and matching said not required bits of said at least one inspected packet 
with other bits of the same packet. 



PHNL04021 8EPP 



13 08.03.2004 



ABSTRACT: 



An integrated circuit having a plurality of processing modules (M, S) and an 
interconnect means (N) for coupling said pluraUty of processing modules (M, S) and for 
enabling a packet based communication based on transactions between said pluraUty of 
processing modules (M, S) is provided. Each packet comprises a first predetermined number 
of subsequent words each having a second predetermined number of bits. A first of said 
pluraUty of processing modules (M) issues a transaction by sending at least one packet over 
said interconnect means (N) to a second of said pluraUty of processing modules (S). The 
integrated circuit further comprises at least one packet inspecting unit (PIU) for inspecting 
bits of said at least one packet to determine bits not required for said issued transaction and 
for matching said not required bits of said aUeast one-inspected packet with other bits of the 
same packet. 
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